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m ' Abstract 



This paper provides extensions of the work on subsampling by Bertail et al. (2004) for strongly 
mixing case to weakly dependent case by application of the results of Doukhan and Louhichi (1999). 
We investigate properties of smooth and rough subsampling estimators for distributions of converging 
and extreme statistics when the underlying time series is rj or A- weakly dependent. 

1 Introduction 

Politis and Romano (1994) [22] established the subsampling estimator for statistics when the underlying 
I/"") ' sequence is strongly mixing. Bertail et al. (2004) [3] applied this work to subsampling estimators for 
distributions of diverging statistics. In particular, they constructed an approximation of the distribution 

OO ■ 

of the sample maximum without any information on the tail of the stationary distribution. However the 
assumption on the strong mixing properties of the time series is sometimes too strong as for the class of 
first-order autoregressive sequences introduced and studied by Chernick (1981) [6j: for i 6 Z, let X t be 
given by 

X t = -(X t - 1 +£t), (1) 
r 

^ . where r > 2 is an integer, (et)tez ar e hd and uniformly distributed on the set {0, 1, . . . , r — 1} and Xq 
is uniformly distributed on [0,1]. Andrews (1984) pQ and Ango-Nze and Doukhan (2004) [2] (see page 
1009 and Note 5 on page 1028) give arguments to derive that such models are not mixing. The results of 
Bertail et al. (2004) [3] can not be used although the normalized sample maximum has a non degenerate 
limiting distribution: let M n = max(Ai, . . . , X n ), then 

lim P(n(l — M n ) < x) = 1 — exp ( — r~ 1 (r — l)x) , for all x > 0, 

n— »oo ' ' 

(see Theorem 4.1 in Chernick (1981) [6]). 

This paper is aimed at weakening the dependence conditions assumed in Bertail et al. (2004) [3] and at 
studying new smooth subsampling estimators adapted to our weak dependence conditions. 

Doukhan and Louhichi (1999) [10] introduced a wide dependence framework that turns out in particular 
to apply to the previous processes and that widely improves the amount of potentially usable models. This 
dependence structure is addressed in Section [2j In Section [3] we introduce smooth and rough subsampling 
estimators for the distribution of converging statistics and studied their asymptotic properties. We 
consider two subsampling schemes based on overlapping and non-overlapping samples. In the next section 
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we consider subsampling estimators for the distribution of extremes and, to fix ideas, we focus on the 
case of the normalized sample maximum. We first discuss sufficient conditions adapted to our weak 
dependence framework such that the normalized maximum converges in distribution. Then we discuss 
how to estimate the normalizing sequences and we derive the asymptotic properties of the subsampling 
estimators. A simulation study provides explicit comparisons of the various considered subsamplers in 
Section [5j Proofs are reported in a last section. 



2 Weak dependence 

Doukhan and Louhichi (1999) [10] proposed a new idea of weak dependence that makes explicit the 
asymptotic independence between past and future. Let us consider a strictly stationary time series 
X = (Xt)tez which (for simplicity) will be assumed to be real- valued. Let us denote by F its stationary 
distribution function. If X is a sequence of iid random variables, then for all t\ ^ t2, independence 
between X tl and X t2 writes Cov (f(X tl ), g(X t2 )) = for all f,g with ||/||oo, Hfflloo < 1, where \\f\\oo 
denotes the surpremum norm of /. For a sequence of dependent random variables, we would like that 
Cov (/ '(' past'), g( l future')) is small when the distance between the past and the future is sufficiently 
large. 

More precisely, for h : M. u — > R (u E N* ) we define 

T . , \h(yi,...,y u )-h(xi,...,x u )\ 
Lip h = sup —r r jj . 

(»,->!/«)/(ii>->2«)6K" 1 1 2/1 — Xl\\ + ■ ■ ■ + \\y u — x u \\ 

Definition 1 [10] The process X is (e,^) -weakly dependent process if, for some classes of functions 
F U ,G V , E U ,E V ^R,u,v > 1: 



e(r) = sup 



Cov(f(X sl ,...,X Su ),g(X tl ,...,X tv ) 







where the sup bound is relative to u, v > 1, si < • • • < s u < t\ < • • • < t v with r = t\ — s u , and f, g satisfy 
Lipf, Lipg < oo and \\f\\oo < 1, \\g\\oo < 1- 

The following distinct functions 1 J/ yield n, and A weak dependence coefficients: 

if^/(f,g) = uLip f + vLip g, then e(r) = r/(r), 

= uLip f + vLip g + uvLip f ■ Lip g, then e(r) = A(r), 

Note that A-weak dependence includes 77- weak dependence. A main feature of Definition [1] is to incor- 
porate a much wider range of classes of models than those that might be described through a mixing 
condition (i.e. a-mixing, /3-mixing, p-mixing, ^-mixing, . . . , see Doukhan (1994) [9])) or association con- 
dition (see Chapters 1-3 in Dedecker et al. (2007) [8]). Limit theorems and very sharp results have been 
proved for this class of processes (see Chapters 6-12 in Dedecker et al. (2007) [8] for more information). 

We now provide a non-exhaustive list of weakly dependent sequences with their weak dependence prop- 
erties. This will prove how wide is the range of potential applications. 

Example 1 • The Bernoulli shift with independent inputs (£t)teZ *s defined as X± = H((^t-j)jez), 
H : M 1, — > R, (£i)iez -id- The process (X t )tez is rj-weakly dependent with rj(r) = 2<5|^ 2 j if 

E\H(tj,j G Z) - 11(^,11, G Z) I < S r I (r t 00). 
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Two particular (causal) examples are given by: 

- The first-order autoregressive sequences with discrete innovations given by ([7]). This process is 
not strongly mixing but it is r]-weakly dependent process such that r](k) = O (r~ fc ) . 

- The LARCH model with Rademacher iid inputs: 

X t = &(l + oX t _i), P(£ = ±l) = i. (2) 

If a < 1, there exists a unique stationary solution (see Dedecker et al. (2007) 18]). Doukhan, 
Mayo and Truquet (2008) proved that if a 6 ((3 — v5)/2, 1/2] the stationary solution Xt = 
S,t + J2j>i a ^t • • • Ct-j is not strongly mixing, but X is a n-weakly dependent process such that 
n(k) = 6{a k ). 

• If X is either a Gaussian or an associated process, then X is X-weakly dependent and 

A( r ) = O ( sup | Cov(X ,Xi) \ ) 

\i>r J 

(see Doukhan and Louhichi (1999) UP}/ ). 

• If X is a GARCH(p,q) process or, more generally, a ARCH(oo) process such that X^ = pkik with 
Pl = b + Ef=i b 3 Xl_ 3 forkeZ and if, 

- it exists C > and [i g]0, 1[ such that Vj £ N, < bj < C^jP , then X is X-weakly dependent 
process with A(r) = O (e~ Cy ^^ and c > (this is the case of GARCH(p,q) processes). 

- it exists C > and v > 1 such that \/j £ N, < bj < Cj~ u , then X is X-weakly dependent 
process with A(r) = O (e~ r ). 



3 Subsampling the distribution of converging statistics 

Politis and Romano (1994) |22j introduced the methodology of "subsampling" to give consistent ap- 
proximations of confidence intervals for some parameters of the distribution of the observations. They 
established the validity of their methodology for general strongly mixing sequences under the assumption 
that the considered statistics converge with a known rate. 

We consider here a sequence of statistics S n = s n (X\, . . . , X n ) for n = 1, 2, . . . Let K n be the cumulative 
distribution function of S n , K n (x) = P(S n < x). We assume that S n is a sequence of converging statistics 
in the sense that K n has a limit which is denoted by K. We assume that the statistics satisfy one of the 
two following assumptions: 



Convergent statistics: 



sup 



l n (x) - K(x) 



< CO. 



(3) 



where IK' denotes the density of this limit distribution. 



Concentration condition: 

su Pa;eIR 



F(S n e [x, x + z]) < C(n)z c (Vz > 0) 

for suitable constants c, C(n) > 0, if n = 1, 2, 



(4) 
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We also consider a bandwidth function b = b n — > oo such that lim n _ >00 ra/& = oo and two subsampling 
schemes 

Y b; i = (Xi + i, . . . , N = n — b, overlapping samples, (5) 

Tl 

Y b>i = (X(j_ 1)6+1 , . . . ,X ib ), N = -, non-overlapping samples. (6) 

Then we introduce a smooth and a rough subsampling estimator for K 

JV-l 



Kfe jn (x) = — ^2 f ( b ") i smooth subsampled statistics, (7) 

1 N ~ l 

Kf, )n {x) = — y^I(s&(lfc^) < x), rough subsampled statistics, (8) 
i=o 

where I is the indicator function. Here, e n \, and is the non-increasing continuous function such that 
ip = 1 or according to x < or x > 1 and which is affine between and 1. From the convergent 
statistics assumption ©, one easily checks that the bias of our first estimator is bounded the following 
way: 

sup E[K M (x)] - K(x) < r b + cIlK'Hoo. (9) 



Remark 1 (discussing assumptions) 



• The rough subsampler ([8]) is the usual one. However in order to derive uniform a.s. convergence this 
estimator will need the stronger concentration condition due to the specific problems related 
to weak dependence. Indeed this estimate is based on indicators which are not Lipschitz functions 
and bounds for covariances are more hard to handle. Besides the simple stationary Markov case for 
which existence of a bounded transition probability density is enough to assert that c = 1, examples 
for which those concentration conditions are proved may be found in Doukhan and Wintenberger 
(2007, 2008) [13] and [H]. 

• The two techniques of subsampling developed here are based on overlapping or non-overlapping 
samples; it is clear that ([5]) is much more economic in terms of the sample size n since the cor- 
responding sum runs over (n — b) indices while this number is only n/b in case ([6]). However the 
latter condition assumes less restrictive weak dependence, since the involved b— samples are more 
distant. 



In order to prove either uniform strong or weak laws of large numbers, we aim at bounding the p— th 
centered moments of Kb !n (x) and HQ, jra (x) defined as 



Ag(*) 



E 



K b Jx) - E[K b Jx)] 



A£(x) 



E 



K b>n (x) -E[K M (x)] 



Borel-Cantelli lemma will then allow to conclude. 



For simplicity we set the notation L(b) = Lips?,. Moreover, for two sequences a = (a n ) and b 
a -< b means that there exists a positive constant c such that, for all n, a n < bc n . 



{b„ 



We first give results for the smooth subsampler by considering the convergence condition ([3]). Almost 
sure convergence is obtained to the price of restrictive conditions that meets all the qualities required in 
our framework. 
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Theorem 1 (Smooth subsampler) Assume the convergence assumption (GJJ hold. Let 5 > and 
p E N* . Assume moreover that if respectively the overlapping setting is used and one among the following 
relations hold asn-J-oo 

°° b ( L{b\ \ 

r]- dependence: + l) p ~ 2 r](t) < oo, -IV — — ] -< n _<5 , or 

A- dependence: 2_^(t + l) p 2 X(t) < oo, - IV — V — ^- ^ n d , 



t=0 

or the non-overlapping setting is used and 

n-l 



r)- dependence: VVt + l) p_2 r/(i) -< fe^ 2 , - MV — ) -< n^, or 
i=o ^ V £ n y 

X-dependence: J> + 2 A(i) -< ^" 2 , £ (l V ^ V -< n- 5 . 



Hence, from Borel-Cantelli Lemma, if p/2 E N is suc/i that p5 > 2, then 



sup 



(x) - K(x) 



o.s. 



Finally, for completeness, we give results for the rough subsampler by considering successively the con- 
vergence condition ([3]) and the concentration condition (|4|). 

Theorem 2 (Rough subsampler under condition ([3])) Assume that the convergence assumption |3|) 
holds. If respectively the overlapping setting is used and one among the following relations hold 



V- .x 1 , b ( L(b)\ 
ri -dependence: > ri ftp < oo, hm —IV — ■=■ = 
^ n->oo n V Vb J 

OO / 4 — — \ 

X-dependence: ^A(t)§<oo, lim ^ (l V v ^ J = 



t=o 

or the non-overlapping setting is used and 



rj- dependence: ^^r/(i) 2 < oo, lim — ^1 V VbL{b)^ = 

t=0 n co n 

00 2 6 .2 1 

X-dependence: VA(()I < oo, lim - f 1 V (bL(b) 2 )i V (olio) 2 ) 3 ) = 0, 

* — ' n— »oo n V / 



t=0 



i/ien limn^oo A b ^(x) = and 



lim sup 



h,n(x) ~ K(x) 



0, in probability. 
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Theorem 3 (Rough subsampler under condition (f4l)) 

Assume that the concentration assumption holds. Let 5 > and p £ N*. Assume moreover that if 
respectively the overlapping setting is used and one among the following relations hold, as n — )• oo, 

oo 

—9 2+c 

rj- dependence: ^ (t + l) p 77(t)!+ c <oo, 

n 



(l v (C^r 1 ^) 6 ) x + c v (6L(6) 2+C ) -< 
A- dependence: ^(i + l) p_2 A(t) 2+ c < 00, 



t=0 

- (l V (C(6) 2 6 c - 2 L(6) 2c )^ V (C(6)6- 2 L(6) C )^ V (C(6)6 c - 2 L(6) 2c )^) -< n" 5 
or the non-overlapping setting is used 



t=o 

/?, 

rc-1 



1 V (C(b)(bL(b))' )— V (/;!(/>) jt^r ) . 

\-dependence: + l) p " 2 A(t)^ -< 6?" 

t=o 

^(l V (C(6)(6L(6)) C )^ V (C(6)(6L(6)) C )^ V (H/;) (/>!(/>) r'.) — j ~, „-\ 

T/ien 

Hence, if p/2 G N is smc/i i/iat p5 > 2, then 



sup 

rreIR 



(x) - K(x) 



a.s. 



The rough subsampler needs a very strong concentration assumption and excessively intricate weak 
dependence conditions for uniform strong consistency. Such conditions are definitely hard to derive in 
the most general settings. 

Remark 2 

• For Theorem [1] and O if one of the above mentioned relations hold with p = 2, then we obtain the 
same result but only with respect to the convergence in probability. 
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Choosing the procedure. The overlapping frame yields a more expensive procedure, in terms of the 
assumptions of the bandwidth. A strange feature of the results is that, for the a.s. convergence 
case where moments with high order need to be calculated, that weak dependence assumptions are 
weaker in this case. 

Monitoring the smoothing parameter e n . A bit more may be found from the previous result. The 
square of bias of our statistics is indeed given as 0(e 2 + r?) while now the order of variance is 
respectively 

Overlapping ^-dependence: —(IV ' 



b ( Lib) bL(b) 2 
A-dependence: -IV — ^ V — ) r — 



Non-overlapping ^-dependence: — IV 



b ( bL{b)\ 



n \ e. 

b / bL(b) bL(b) 2 
A-dependence: - ( 1 V — — V — 



Hence eg. under //—dependence a reasonable choice for this parameter is e n = {bL{b)/n) 1 ^ (resp. 
(6 2 L(6)/n) 1 / 3 for the non-overlapping case). Notice however that the order of the quadratic ap- 
proximation of our subsampler is always bounded by max{r 2 , b/n}. 

If the process is centered, the CLT writes with the statistics t b (x\, . . . ,x b ) = (x% + • • • + x b )/Vb; 
here L(b) = 6 -1 / 2 and we choose respectively e n = 6 1//6 n _1//3 , or 6 1 / 2 n -1 / 3 . 

Uniformity. The fact that cp is monotonous is essential in order to derive uniform convergence of 
those subsamplers; it indeed allows to use the standard variant of Dini Theorem. 

Confidence bands. For a statistical validation of the technique, a CLT theorem is also required. A 
first step for such a central limit theorem is to precise the asymptotic variance. For simplicity we 
shall mention hard subsampling of a convergent sequence of statistics ([3]). In this case lim&K&(;c) = 
K(x) and the variance of should involve also t bj i(x) = Cov (H S() (y n )< x ,lI S() (y n 4 )< x )- As in the 
proofs a concentration assumption leads to < const • n c (j — b) (resp. < const • X c (j — b)) in 

the case j > b and for a suitable constant < c < 1; for the non-overlapping scheme we only need 
j > 1 and j — 6 is now replaced by (j — 1)6. The claim is now that 

n VarKfy tn (x) — > S^t<u(x), to(x) = K(x)(l — K(x)), tj(x) = lim tbj(x). 

k 

An analogue result in the nonverlapping case writes more simply 

- VarK bn (x) ->• t (x) + 2t 1 (x), t (x) = K(x)(l - K(x)), h(x) = lim t b i(x). 

b b— >oo ' 

This is a first step for a CLT because in both cases the normalization coefficient is N. Anyway 
proving a CLT involves a more precise analysis of the situation and the use of Lindeberg method 
with Bernstein blocs. However, the knowledge of this limit variance already provides a reasonable 
confidence band for this estimator. 



4 Subsampling the distribution of extremes 

Bertail et al. (2004) [3] studied subsampling estimators for distributions of diverging statistics, but im- 
posed that the underlying sequence is strongly mixing. We aim at generalizing their results for weakly 
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dependent sequences. Instead of considering the general case, we focus on the sample maximum because 
we are able to give sufficient conditions such that the normalized sample maximum converges in distri- 
bution under the weak dependence assumption. Note however that the results can easily be generalized 
provided that it is possible to compute the Lipschitz coefficient of the function used to define the diverging 
statistics. 



4.1 Convergence of the sample maximum 

We first discuss conditions for convergence in distribution of the normalized sample maximum of the 
weakly dependent sequence. 

Let xf = sup{x : F{x) < 1} be the upper end point of F and F := 1 — F. We say that the stationary 
distribution F is in the domain attraction of the generalized extreme value distribution with index 7, 
— 00 < 7 < 00, if there exists a positive and measurable function g such that for 1 + jx > 



lim F(u + xg(u))/F(u) = (1 + 72;)' 

u— >XF 



-1/7 



Then there exist sequences (u n ) n >i and (f n )n>i such that u n > and 

lim F»K(x)) = G 7 (s) := ( ^H 1 ^ * °> (10) 

n^oo 1 exp(— exp(— x)) if 7 = 0, 

where w n {x) = x/u n + v n . Let q (t) = F^ (l — i -1 ) where F^~ is the generalised inverse of F. Then 
(un)n>i and (v n ) n >i can be chosen as 

v n = q (n) 

r (-j)(x F -q(n)) if 7 <0, 

u^ 1 = I q(ne)-q(n) if 7 = 0, 

[ 11 ( n ) if 7 > 0. 

Let us introduce the extremal dependence coefficient 

P^i = sup |P (Xi < w n {x),i G AuB)-¥{Xi< w n {x),i G A) P (X { < w n (x),i £ 5) |, 

where the sets A and B are such that : A C {1, . . . , k}, B C {k + /, . . . , n}, and 1 < k < n — I. 

O'Brien (1987) [19J gave sufficient conditions such that the normalized sample maximum u n (M n — v n ) 
converges in distribution when the stationary distribution is in the domain attraction of some extreme 
value distributions. 

Theorem 4 119)/ Assume that F is in the domain attraction of the extreme value distribution with index 
7. Let (a n ) be a sequence of positive integers such that a n = o(n) as n — >■ 00 and 

P(M >,M) =() M 

n^oo a n F(w n {x)) 
Assume that there exists a sequence (l n ) of positive integers such that 

Tl 

l n = o (a n ) and —Pn,l n ->-n-»oc as n -> 00. (12) 

Then 



lim P(M n < Wn (x)) = ( ex P(-^ + ^)+ 1/7 ) if 7 7^0, (13) 
n-400 exp(— w exp(— x)j 1/7 = 0. 
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The constant is referred to as the extremal index of X (see Leadbetter et al. (1983) [IS]). Note that 
any l n = o (n) such that ft n ,i n — > as n — > oo can be used in constructing a sequence a n such that (fl~2"j) 
is satisfied by taking a n equal to the integer part of max(re/3* ^ , (n/„) 1//2 ). The condition /3 nj ; n — ► as 
n — > oo is known as the D{w n ) condition (see Leadbetter (1974) [IB]). 

We provide an equivalent theorem when X is assumed to be either r\ or A-weakly dependent. 

Theorem 5 Assume that F is an absolutely continuous distribution in the domain of attraction of the 
extreme value distribution with index 7 such that for 1 + 72; > 

lim JL F n {Wn{x)) = |-G 7 (X). (14) 

n-5>oo ox OX 

Let (a n ) be a sequence of positive integers such that a n = o (n) as n — )• 00 and Ml}) holds. Assume that 
there exists a sequence (l n ) of positive integers such that l n = o{a n ) (n — >• 00). If X is n-weakly dependent 
and 

— {nr](ln)u n ) 1/2 ->„^oo 0, 
a n 

or if X is X-weakly dependent and 

— ([n\(l n )u n ] 1/2 V \na n X(l n )ul] 1/3 ) -^ n ^oo 0, 
a n \ J 

then |73p holds. 



4.2 Subsampling the distribution of the normalized sample maximum 

Consider the sequence of extreme statistics 

M n = m n (X\, ... , X n ) = max Xj. 

l<i<n 

Set M n (x) = P(M n < x). Restate the smooth subsampling estimates for non-normalized extremes by 



1 / m b (Y b i ) - x 



i=Q 



(15) 



Assume, under the assumption of Theorem [5J that (|3|) adapted to normalized extremes holds, i.e. 



sup I 



(w n (x))-U(x)\ 



0. 



where 



--Gi 



Following the lines of Bertail et al. (2004) [3], we have to impose conditions on the median and the 
distance between two quantiles of the limiting distribution in order to be able to identify it. The median 
of the limiting distribution to estimate is assumed to be equal to and the distance between the quantiles 
is assumed to be equal to 1. Fix < t\ < < 1. Then the normalizing sequences can be estimated by 



Vb,n 



Ub.r 



(t 2 )-Mt n (h) 



(16) 



Let C = W^fe) — H <_ (ti). Using that here L(b) = Lipm^ = 1, we derive from Theorem Q] and Theorem 
4 in Bertail et al. (2004) [3] the following theorem. 
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Theorem 6 Assume that the conditions of Theorem [5| hold. Let 5 > and p G N*. 



The relation 



E 



~" -~ jP r p -I f 

H;, )n (t«fc(a;)) — E[Hi, )tl (t(Ji,(i))] -< n~^' holds if we assume that ]im n -y oa e n u& = and 



respectively (as n — )• oo ) that: 



in the overlapping case, 



n-weak dependence, ^^(^ + 1) P 2 v(t) < °°; i_$ < 1> 



or 



t=o 

oo 



X-weak dependence, + l) p 2 A(i) < oo, 2 -< 1, 



t=o 



in the non-overlapping case, 



n— 1 



rj-weak dependence, ^^(^ + 1) P 2? ?(^) 



i=0 
n— 1 



X-weak dependence, + 1) P 2 A(i) ^ ^ P 2 ) 



62 

~~1=3 < 1 ' 0r 



< 1. 



t=o 



^1—6^2 



Hence, ifp/2 G N is smc/i i/iai p5 > 2, then 

x 



sup 



«6,i 



a.s. 



5 Simulation study 

The finite sample properties of our subsampling estimators are now compared in a simulation study. We 
consider both rough and smooth subsampling estimators when they are computed with the overlapping 
or non overlapping schemes. 

Sequences of length n = 2,000 and n = 5,000 have been simulated from the first-order autoregressive 
process of Example ([I]) 

X t = -(Xt-i+e t ), 
r 

where (et)tez are hd and uniformly distributed on the set {0, 1, . . . , r — 1} and r is equal to 3. It is well- 
known that the asymptotic condition (|13p holds with 7 = —1, 6 = r _1 (r — 1), u n = n and v n = 1 — n _1 . 
Following the approach presented in the previous Subsection 14.21 we have to fix conditions on the median 
and two quantiles of the limiting distribution. We choose ti = 1/4 and £2 = 3/4. The limiting distribution 
becomes 

K(x) = e -*(i-(*-«OA0 f x<c + d, 
where c = #/ln3 and d = (In 2 — #)/ln3. The normalization coefficients u n and v n such that 

lim F(u n (M n - v n ) <x) = K(x) 

are given by 

Vn =v n — c^ l u^d, u n = cu n . (17) 
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We first simulate a sequence of length n = 2, 000 and plot the estimators of the limiting distribution in 
Figure 1. As expected, smoothing estimators yield smoother curves. The differences between the estima- 
tors are small but the smoothed versions need less strong assumptions for their trajectorial convergence. 




-3 -2 -1 o 



Figure 1: AR(1) process - The rough (dashed) and smooth (solid) subsampling estimators computed 
with the non- overlapping scheme (thin) and with the overlapping scheme (thick) for a sequence of length 
n = 2,000. 6 = 50, e = 0.05. 

Monte Carlo approximations to the quantiles and the means of the estimators have been then computed 
from 1,000 simulated sequences. 

The properties of our rough and smooth subsampling estimators computed with the non-overlapping 
scheme are shown in the two upper graphs in Figure 2. There are very few differences between both 
estimators according to their quantiles and their means. Their biases are negligible for all the value of 
x. The confidence intervals with level 90% (gray zone) vanish when x goes to because is the median 
of the empirical distribution, but also the median of the asymptotic distribution. We may compare the 
quantiles and the means of our estimators with those obtained when the normalization coefficients given 
by (|16p are replaced by the theoretical normalization coefficients given by (|17h (see the two lower graphs 
in Figure 2). First note that the bias become negative when x is smaller than the median. Second the 
confidence intervals are obviously not equal to zero for the median but they are more narrow than the 
confidence intervals of our estimators when x is close to the extremal point of the asymptotic distribution, 
c + d. 

The properties of our rough and smooth subsampling estimators computed with the overlapping scheme 
are shown in Figure 3. We chose the same value for b as in the non-overlapping scheme and consequently 
the number of components in the definition the estimators is quite larger than in the other scheme. It 
follows that the empirical distribution functions given by the estimators computed with the overlapping 
scheme are smoother than those of the estimators computed with the non-overlapping scheme. The 
intervals confidence are also a little bit more narrow. 
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Moreover note that qualitatively similar results were found when the simulations were repeated with 
n = 5,000, b = 100, e = 0.05. 



Self normalization Self normalization 




-3-2-10 1 -3 -2 -1 



Theoretical normalization Theoretical normalization 




-3 -2-10 1 -3 -2 -1 

x x 



Figure 2: AR(1) process - Monte Carlo approximations to the quantiles (qo.os and qo.95) (gray zone) and 
means (dashed line) of the rough (left) and smooth (right) subsampling estimators computed with the 
non- overlapping scheme when the normalization coefficients are given by $16\) (top) or by flTp (bottom). 
The asymptotic distribution function, K, is given by the solid line, n = 2, 000, b = 50, e = 0.05. 



Finally sequences of length n = 2,000 have also been simulated from the LARCH model with Rademacher 
iid inputs ([2]) and with inputs that have a parabolic density probability function given by x \— > 0.5(1 + 
for x £ [—1, 1]. Note that the Rademacher distribution can be seen as the limit of the parabolic 
distribution as p goes to infinity. We choose a = 0.4. Hence the process is weak dependent but not strong 
mixing when the inputs have a Rademacher distribution, and it is strong mixing when the distribution 
of the inputs is absolutely continuous. Neither the stationary distribution, nor the extremal behavior of 
the processes are known. Note however that the end points of the stationary distributions are finite. 

We perform simulations and use our estimators. Results are given in Figure 4. The shapes of the 
empirical distribution functions given by the estimators are different for the two processes (in particular 
for the large values of x). As far as we can see, the generalized extreme value distribution with a negative 
index could be a good choice to model the distribution of the maximum of the process with absolutely 
continuous inputs but not to model the distribution of the maximum of the process with Rademacher 
inputs. The study of the extremal behavior of these processes are intricate and left for future work. 
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Self normalization Self normalization 




-3 -2-10 1 -3 -2 -1 



x x 

Theoretical normalization Theoretical normalization 




-3 -2-10 1 -3 -2 -1 



Figure 3: AR(1) process - Monte Carlo approximations to the quantiles (50.05 an d Q0.95) (9 ra V zone) and 
means (dashed line) of the rough (left) and smooth (right) subsampling estimators computed with the 
overlapping scheme when the normalization coefficients are given by hl&) (top) or by |7?|) (bottom). The 
asymptotic distribution function, K, is given by the solid line, n = 2, 000, b = 50, e = 0.05. 

6 Proofs 

6.1 Proofs for smooth subsampling 

A bound of the expression a[ p ^(x) is closely related to the coefficients defined for 1 < q < p as: 

Cb, q (r) = sup |Cov (Z h ■■■Z ik , Z ik+1 ■ ■ ■ Z iq ) \ 

where the supremum refers to such indices with 1 < k < q, i\ < ■ ■ ■ < i q satisfy ik+\ — ik = r and 
Zi = (p ( Sb(Yb £~ X ^J - E</? ( Sb{¥b e '^~ X ) is a centered rv. Then setting 

A b:q (N) = ^- q \®Z h ---Z iq \, 2<q<p 

l<h<-<i q <N 
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Non-overlapping 



Overlapping 



Non-overlapping 



Overlapping 




Non-overlapping Overlapping Non-overlapping Overlapping 




Figure 4: LARCH processes with Rademacher inputs (the four graphs at left) and with parabolic inputs 
(p = 4) (the four graphs at right) - Monte Carlo approximations to the quantiles (go. 05 an d Q0.95) (gray 
zone) and means (solid line) of the rough (top) and smooth (bottom) subsampling estimators computed 
with the non- overlapping scheme (left) and with the overlapping scheme (right), n = 2,000, b = 50, 
e = 0.05. 

Doukhan and Louhichi (1999) prove that A^(x) < p\A bjP (N), moreover: 

p-2 

A b , p {N) < B b!P (N) + J2\ q (N)Ab, P - q (N) 

q=2 

B *A N ) = ^lE( r+1 )^»' 2<q<p 
r=0 

Lemma 1 Let p,q,b,N be integers and (3{b,N) < 1, we assume that for all 2 < q < p there exists a 
constant c q > such that B^ q (N) < c q (3z{b,N). Then there exists a constant C p > only depending on 
p and Ci, . . . , c p such that A biP (N) < C P /3W (^ N). 



Proof of the lemma 1 The result is the assumption if p = 2 because A b ^{N) < B b ^{N). If now the 
result has been proved for each q < p the relation [|] < [|] + [^^-] completes the proof because j3{b, N) < 1. 



A covariance Cov (/{Y^ , . . . , Yi u ),g(Yj 1 ,Yj v )) writes respectively as 

Cov (^f b ^(Xi h+k )^ 1 1 h 1 u ^ , 9b {[ x j h i+k') 1 1 < h' t < u ^ ) 

Cov(/ b I (^( ife _i)6+fc) r i<h<u I, g b ( ( x (j h ,-i)b+k>) ( i<h'<u )) 

^ ^ \ \ 1 < fc < b J \ \l<k'<b/' 

for suitable functions fb,g b depending if the considered setting is the overlapping one or not. Moreover 
Lip/5 < Lip / which proves that if the dependence coefficients relative to the sequences X = (Xj)j e z 
are denoted by r]x(r) = rj(r) and r/Y b (r), then we get the elementary lemma 
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Lemma 2 (Heredity) Assume that the stationary sequence X = (-Xj)j e z is weakly dependent then the 
same occurs for Yj, = (li)igz an d-' 



• r/Y b (r) < brj(r — b) if r >b in the overlapping case, 

• Ay b (r) < b 2 X(r — b) if r > b in the overlapping case, 

• VY b ( r ) < brj((r — 1)6) ifr>l in the non- overlapping case, 

• Ay b (r) < 6 2 A((r - l)b) if r > 1 in the non- overlapping case. 

In our setting we use the function f{yi,---,y b ) = f ( V the covariance inequalities 

write here as: 

Lemma 3 Using conditions (E|[6|) and under the respective weak dependence assumptions rj and A we 
respectively get 

• in the overlapping case, C\, „{r) -< 1 for r < b and else, resp. 

C b , q (r) * ^(r - 6), or C b , q {r) ^ f 1 V ^ A(r - b) 

• in the non- overlapping case, C& ? (r) -< 1 for r = and eke, resp. 

C^r) -< ^((r " D&), or C b , q (r) ^ f 1 V ^ A((r - 1)6) 

This lemma entails the bounds: 

• Overlapping and ^-dependent case. We obtain 



r=0 r=b 

*J 1 + — S ,(() r S (tTiFi 



I 

\ \ I \ , . 

t=0 

where the second inequality follows from the change in variable r = t + b. We use here N = n. Now if 
we assume b -< n l ~ & we deduce that (b/n) q ~ l -< n~? s and if bL(b) -< n l ~^e n we analogously derive that 
(b/N) q - l (L(b)/e n ) < n~i 5 . Assume now that 

n 



this implies with (t + I) 9 2 n(t) < oo that Bb iq (N) 



-< n 2°. 



t=o 
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• Overlapping and A-dependent case. We obtain 



1 (bL(b)) 2 ^ A(r-6) 



+ 



(r + I) 2 "? 

n r=b v ' 



(*) O+i 1 E A (" + ^r- E A <") 

v 7 t=o n t=o 

i (bHb)*^ 1 \(t) ( bL (b)r N ^ x(t) % 



AT9 

where the second inequality follows from the change in variable r = t + b. We use here N = n. Now 
if we assume b -< n 1 ^ 5 we deduce that (b/n) q ~ l -< n~i s . Now if (bL(b) V (bL(b)) 2 ) -< n 1 ~ 5 (e n V e 2 n ) we 
analogously derive that (b / N) q ~ l (L(b) / e n V 6L(6) 2 /e 2 l ) -< rT^ 8 . Assume now that 



n 



-2,5 

n 2°. 



this implies with ^ (t + l) 9 2 A(t) < oo that B b>g (N) -< 
t=o 

• Non-overlapping and 77-dependent case. We obtain 



B fAH -< 1 1 frL(fe) ^ ^((r - 1)6) 

^,<A^j -< 7V? _ 1 + 7V9 _ 1 ^ ^ ( r + 1)2-, 

n fc=i n fc=i 

where the second inequality follows from replacement of A; = 6(r — 1). We use here iV = n/b. Now if 
we assume b -< n 1-5 we deduce that (ft/n) 9-1 -< nTa" 5 and if b 2 L(b) -< n 1 ~ s e n we analogously derive that 
(l/^- 1 )(6L(6)/e n ) ^n^f- 5 . Assume now that 



n V £n / 



n-l 



this implies with ^ (t + l) 9 2 77(f) < 6 9 " 2 that B b>q (N) ~< n 
t=o 

• Non-overlapping and A-dependent case. We obtain 
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H tm -< 1 > 1 bL(b) N ^ X((r - l)b) 1 (bL(b)) 2 ^ A((r-l)b) 

H In) ^tE^ + ^E^) 

1 / b 3 ~gL(b) ^ A(fc) 6 5 -9L(6) 2 ^ A(fc)\ 

+ iV?- 1 1 e n ^ fc 2 -? + e 2 ^ k 2 ~i I ' 
\ n k=b n k=b J 

where the second inequality follows from replacement of k = b{r — 1). We use here N = n/b. Now if 
we assume b -< n 1 " 5 we deduce that (b/n)^ 1 -< n~i s . Now if (b 2 L(b) V (bL(b)) 2 ) -< n 1_5 (e n V e 2 ) we 
analogously derive that (l/N g ~ 1 )(bL(b) / e n V &L(6) 2 /e 2 ) -< n^a 5 . Assume now that 

n V e„ ei 



71-1 



this implies with ^ (* + i)^ 2 A W < ( &9_2 v & "~ 4 ) that -< 



t=o 



-< n 



Lemma 4 T/ie relation B^ q (N) -< n 2 5 /toWs m i/ie following cases 

• In f/ie overlapping case, if we have respectively 

EZait + V q ~ 2 v(t) < 00, and - (l V ^ ] -< n~ 5 , 
^00 , v„ 9,m , & f Lib) bL(b) 2 \ 

• In t/ie non-overlapping case, if we have respectively 

+ l) 9 - 2 -7(t) < 6^ 2 , and - f 1 V ^) -< n~ 5 , 

+ l)^ 2 A(i) < (^ 2 V b^) ,and - ( 1 V ^ V -< n~*. 

This lemma together with lemma [T] yields the main theorem. 

6.2 Proofs for rough subsampling 

In this section we shall replace e n by some z > to be settled later and we set (f z (t) = (p (^^)- We now 
set Zi =\ Sb (Y ba )<x} ~ ^(sb(Yb,i) < x) and Wj = (p z (sb(Y b)i )) - Eip z (s b (Y b>i )). An usual trick yields: 

\Cov {Z ll ..-Z lk ,Z lk+1 ---Z lq )\ < \Cov[W h ---W ik ,W ik+1 ---W iq )\ 

v 

+ 2^E|Wi h -Z ik | = U + V 

h=l 
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with U = |Cov (W h • • • W lk , W lk+1 ■ ■ ■ W lq ) | and V = 2pF(s b (Y b>l ) g[x,x + z]). 

A bound for V does not depend on the overlapping or not overlapping case and we get 

J V < 2p(GLip s b z + r b ) -< L(b)z + r b , under assumption ([3]) 
\ V < 2pC(b)z c -< C(b)z c , under assumption flU) 

Set here A P:b:t = bpLips b /z ~< bL(b)/z. The bound of U needs 4 cases (considered in Lemma [3]) with 
• in the overlapping case, U -< 



bL ^ rj(r — b), for r >b 
1, for r < b 



in the overlapping case, U ~< 



bm^ybJM)x{r-b), forr>6 
1, for r < b 

bL{b) r 



in the non-overlapping case, U -< \ 2 ^ r ^ or r — 1 

[ 1, for r = 

in the non-overlapping case, U -< 



v ^i)A((r - 1)5), forr>l 
1, for r = 



We first derive the inequality (t + 1 + 6) 9-2 < 2^ 3 ) V 1 {(t + l) 9 " 2 + fr 9-2 } from convexity if q > 3 and 
sublinearity else, thus: 

(t + 1 + 6) 9 - 2 ■< {t + l) q - 2 + b q - 2 . 

Coefficients C b ^ q {r) -< sup{?7 + V} may thus be bounded in all the considered cases. 

For simplicity we classify the cases with couples of numbers indicating the fact overlapping ([5|) or not 
([6]) setting is used and from the fact the convergence ([3]) or concentration (J3|) is assumed, which makes 4 
different cases to consider). Consider the cases under assumption ([3]). 

- 7] (|5|3[) case. Note that 

C 6j9 (r) -< L(b) (brj(r - b)/z + zj + r b ~< L(b)y/br](r - b) + r b 



with the choice z = \fbrj(r — b). This yields 



\ Jb ^ J ni- 1 (t + l) 2 -1 

7 v " t=0 t=0 y ' 

+ r b , 

where the second inequality follows from the change in variable r = t + b. We use here N = n. Now if 
we assume that b -< n 1 " 5 , we deduce that (&/n)' ? ~ 1 -< n~ q5 / 2 and if bL(b) ~< n l ~ 5 we analogously derive 
that (b/Ny-^L^/Vb) ~< n~i & . If r)(t) ~< and a < r)/2 we assume that 

- ( i v Wf\ + n< n s ^(t + < oo. 

n \ VbJ ^ 
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V Q6|3P case. Note that 

C hq (r) < bL(b) V ((r - l)b)/z + L(b)z + r b -< L{b)^/br,{{r - 1)6) + r h 



where we use z = y / 6??((r — 1)6), then 



B fAn , 1 L(b)Vb ^ ^ V ((r-l)b) 



r=l 

where the second inequality follows from replacement of k = 6(r — 1). We use here N = n/b. Let us 
assume 6 -< n 1 ~ s , then we deduce that (6/n) 9 " - 1 -< n~i s and if 6 3 / 2 L(6) -4 n 1 5 we analogously derive 
that (l/iV) 9 - 1 (L(6)v / 6) -< n~i s . If r](t) ~< and a < n/2 we assume that 



7 00 

- (l V VbLQ>j) + r b -< n- 5 , E^) 1/2 <°°- 



t=0 

A (I5I3H case. Note that 



C 6>ff (r) -< L(6)z+ (6L(6)/z + (6L(6)/z) 2 ) A(r-6)+r fc 
-< 2(6L(6) 2 )§A(r - 6)3 + (bL{b) 2 )h(r - 6)1 + r b , 

with a choice z = (6 2 L(6)A(r — 6))s. Then 

R (N) -< 1 Vfr l IV' 2 l 2(6L(6) 2 )§ ^ A(r-6)^ 



r=0 r=b 

(6L(6) 2 )I ^ A(r-6)§ 

t \ q — 1 / N-b-l N-b-l 

< |- l + (6- 1 L(6) 4 )^ E A(t)U (6-^(6))! E A(t)§ 

' V i=0 t=0 

1 / N-b-l iV-6-1 x/ ,,2 

+ ^ T ((6L(6) 2 )§ V ? A(t 3 2 +(6L(6) 2 )I V - X{t \l 



t=0 v y t=0 



where the second inequality follows from the change in variable r = t + 6. We use here N = n. Let us 
assume 6 -< n l ~ s , then we deduce that (6/n) 9 " 1 -< n~i <5 and if ((6L(6) 2 ) 2/3 V (6L(6) 2 ) 1/3 ) -< n 1 ' 6 we 

analogously derive that (6/iV)"- 1 ((6- 1 L(6) 4 )l V (6- 1 L(6))§) -< n^i 15 . If A(i) -< n~ A and cr < A/2 and 

cr < 2 A/3 we assume that 



1 V (& _1 .L(&) 4 )s V (6~ 1 L(6))§) + r b -< n 
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with Y^tt + l) 9_2 A(t) 1/3 < oo and ^(t + l)^ 2 A(t) 2 / 3 < oo. 

t=0 t=0 

- A (EH case. Note that 



C b , q (r) * (L(6), + , fe ) + ^ + (^) 2 jA((,-l)6) 

~< 2(6L(6) 2 )§A((r - 1)6)3 + (bL(b) 2 )h({r - 1)6)1 + r b , 
with a choice z = (6 2 L(6)A((r — 1)6)) a. Then we obtain 



r=l 



+^^E>+ir 2 M(r-i)6)«+^ 



r=l 

n—l n— 1 



, ^rr(l + (6L(6) 2 )§ ^ A(fc)3 + (6L(6) 2 )I ]T A(fc)l 



k=l k=l 



k=l k=l 

where the second inequality follows from the change in variable k = b(r — 1). We use here N = n/b. 
Let us assume 6 -< n 1_<5 , then we deduce that (b/n) q ~ l -< n~? s and if ^bsL(b)s V 6sL(6)s^ -< n 1_<5 then 

we analogously derive that (b/n)^ 1 {{bL(b) 2 )i V (6L(6) 2 )^ -< n~2 S . If A(i) -< n~ x and <r < A/3 and 
a < 2 A/3 we assume that 

\bL(b) 2 )i V (6L(6) 2 )I) + r b ~< n' 5 



b 



n 

n—l n—l 



with J^i 1 + l) 9 ~ 2 A(t) 1/3 < oo and J^(t + l)^ 2 A(t) 2/3 < oo that bound holds. 

t=0 t=0 
Consider now the cases under assumption Q. 

- i] (01D case. Note that 

C btq (r) ~< L(b)b7](r-b)/z + C(b)z c 

1 2+c 

-< \C(b)(bL(b)r)(r - 6)) c ) 1+c + (bL{b)-q{r - 6)) 1+c 
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with a choice z = (bL(b)r](r — b)/C(b)) c+1 , then 
Bb, g ( N ) 

1 ^ -2 (C(b)(bL(b))°)T& sr- , 7 • , — 

■< ^rE( r + 1 ) 9 + N «-i J2(r + 1)« 2 (v(r-b)y + c 

r=0 r=6 

2+e 

/ , \ q-1 N-b-1 N-b-l 

^ (n) { l +{c(b)b- i L(br)—^ £ v(t)^ + (bL(bf +c )^ ^ m 

^ ' t=o t=o 

i=0 V ; t=0 V ; 

where the second inequality follows from the change in variable r = t + b. We use here N = n. Now if we 
assume b -< re 1-5 we deduce that (b/n) q ^ 1 -< n~2 S and if b ((C (b)b~ l L(b) c )~^~ c V {bL{b) 2+c )^+^ -< n 1 ^ 5 

we analogously derive (b/N)"- 1 (((7(&)& -1 L(bf)^ V (bL(b) 2+c )^ ) -< n"f 5 . 
If ry(t) -< n _r? and ct < and <r < »/fi§ we assume that 



11 



1 V (C(&)6 -1 .L(&) C ) V (6L(6) 2 



-< n 



which implies with ^ (* + i) 9 " 2 ^O) 1 ^ < &"~ 2 and ^ (i + 1)"~ 2 < b q ~ 2 that B 6 , ff (JV) ~~ 

t=o t=o 
- r] (JSED case. Note that 

C btq (r) -< L{b)bn({r-l)b)/z + C(b)z c 

-< {C(b)(bL(b)r)((r - l)b)) c ))^ + (bL(b)rj((r - 1)6))^ 

i 

with a choice z = (bL(b)rj{{r — l)b)/C(b)) c +! . Then 

r=l 

2 + e 

r=l 



-< n 2°. 



n— 1 n— 1 

2+c 



^(l + (C(6)(6L(6)) c )i^ J>(fc)^ + (6L(6))^ J>(fc)^ 



n— 1 



k=b 

n-1 /,s2+£ 

r/ ,s2±£,4+3c_ ^ ?7(fc)l+c 

+ L(6)i +C &i +C 'E^p^ 
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where the second inequality folllows from the change in variables k = b(r — l). We use here N = n/b. Now 
if we assume b ~< n l ~ & ', we deduce that (b/n)^ 1 H n~i 5 . Now if (l V {C(b)(bL(b)) c ) V (6L(6))^) -<! 

5 we analogously derive (l/N)^ 1 (l V (C(6)(6L(6)) C )^ v (6L(6))?+f ) -< n~i 6 '. If r/(i) -< and 



?i 



c < ^1x3 an d cr < 77 we assume that 



^ (l V {C{b){bL{b)f)^ V (6L(6))^f) -< n- 5 



n— 1 n— 1 



which implies with ^ (i + l) 9 2 r?(t) -< 6 9 ~ 2 and ^ + l) 9 2 r?(t) ^ -< b q ~ 2 that B b<q (N) -< ~~ 

t=o t=o 
- A (OH) case. Note that 

C M (r) -< C(b)z c + (bL(b)/z + {bL{b)/z) 2 ) A(r - 6), 

-< (C(6)6L(6) c )5Ts(A(r - + fc(6)(6L(6) c )^) (A(r - b))%* 



n-l 5 . 



+ (^C(6)(6L(6)^ C )— ) (A(r - &))a+s, 

with a choice z = ((6L(6)) 2 C(6)- 1 A(r - b))& 
B b , q (N) 

J_ + 1 VM« 4. (g(&)(^(6)) c )^ A(r - 



(C(6)(frL(fr)) c )^ ^ A(r-b)^ (C(fr)(frL(6)) 2c )^ y. 1 A(r-6)^f 

c/-l JV-6-1 



- (l + (C(6)V- 2 L(6) 2c )^ £ A(t)*?= 

' t=Q 

N-b-1 N-b-1 

+ (C(b)b- 2 L(b) c )^ A(t)^ + (C(6)6 c - 2 L(6) 2c )^ ^ A(i)^ 

t=0 t=0 

N-b-1 w.\ — N-b- 

—Mc{b){bL{b)f)^ 7rHS-i + (^)(^( & )) c )^ £ 



AT9-H V v /v y "' ^ ( t+ i)2- 9 v w\ wy , ^ (t + 1)2-9 

t=0 v ; i=0 v y 



N-b-1 w , N i±£ 

+ (C(6)(6L(6)) 2c )^ £ 



A(t)2+s 



where the second inequality follows from the change in variable r = t + b. We use here N = n. Now if 
we assume that b -< n 1 ^ 6 we deduce that (b/n) q ~ 1 ~< n~i s . 

lib((C{b) 2 b c - 2 L{b) 2c )^ V (C{b)b' 2 L(b) c )^ V (C(6)6 c - 2 L(6) 2c )^) -< n 1 ' 5 we analogously derive 

(b/Nf- 1 ((C(b) 2 b c - 2 L(b) 2c )^ V (C(6)6- 2 L(6) C )^ v (C(b)b c ~ 2 L(b) 2c )^ -< n"!* 5 . 
If A(t) -< n~ A and cr < A^; and cr < A 2 -^ we assume that 

(l V (C(b) 2 b c ~ 2 L{b) 2c )^ V (C{b)b~ 2 L(b) c )^ V (C(6)6 c - 2 L(6) 2c )^) -< n' 5 



b 

n 
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which implies with ]T (t + l) 9 " 2 A(t)^ < and ^ (t + l) 9 " 2 A(i)^ < 6 9 ~ 2 that S 6)? (iV) -< 

t=o t=o 
- A ((Bill) case. Note that 

-< (C(6)(6L(6)) c )^A((r - 1)6) sfc + ((C(6)(6L(&)) C ) ^ A((r - 1)6)3+1 
+ ((C(6)(6L(6)) 2c )^)A((r-l)5)^, 



n 2". 



with a choice 2 = ({bL(b)) 2 C {b)~ l \((r - 1)6)) 2+-. We obtain 

r=l 

^ (t) S l# & +1 )-%-.)# 



r=l 



r=l 



1 n—l n— 1 

-< + (C(b){bL{b)Y)^ Y, A ^ + (C(b)(bL(b)T)^Y, x ^ m 

k=l k=l 



n—l n—l . 

1 A ( fc ) 2 + C 



+ (C(6)(6L(6)) 2c )^^A(A ; )^)+-^((C'(6)L(6r)^6^ £l -^ 



k=l k=l 

n—l w ,sl+£ n-1 , /n l±£ 

1 4+3c A(fc) 2 +c o 1 4(l+c) X( fc) 2+c 

+ (C(l)I(i)^^'' £ + (C(6)L(6) 2c )^^" 9 £ 

fe=i fe=i 

where the second inequality follows from the change in variable k = b(r — 1). We use here N = n/b. Now 
if we assume that b -< n 1-5 we deduce that (b/n) q ~ l -< n~2 S . 

If b ({C(b)(bL(b)) c )^ V (C(b)(bL(b)) c )^ V V(C(b)(bL(b)) 2c )^) ~< n 1 ' 5 we analogously derive that 



{b/N^- 1 ({C{b){bL{b)) c )^ V {C{b){bL{b)) c )^ V (C(6)(6L(6)) 2c )^) -< n~2 5 . If \(t) ~< n - x and cr < 
Ayq^ and <r < A|±^ we assume that 

6/ 2 1 ol\i 



1 V (C(6)(6L(6)) c )5+s v (C(6)(6L(6)) C )^ V {C(b)(bL(b)Y c ) — j -< n 

n—l n—l 

which implies with J^(t + l) 9 ~ 2 A(t)^ -< ft?- 2 and J^(t + l) q - 2 \(t)^ ~< b q - 2 that B&, g (JV) -< n~i s . 



t=o t=o 



^ (2) 

Lemma 5 The relation A; ' ( 

— ^*n— ^oo holds in the following cases under the convergence assumption 

w 
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In the overlapping case, if we have respectively 



IXo^) 1/2 <°c, and r 6 +^lV^j^0, 



In i/te non-overlapping case, if we have respectively 

oo , 

^^(t) 1 / 2 < oo, and r 6 + - (l V V&£(6)) ->■ 0, 



t=o 



^2 Ktf /3 < oo, and r b + - (l V (bL{b) 2 ) 2/3 V (6L(6) 2 ) 1/3 ) -»• 0. 



n 
t=o 



This lemma together with lemma Q] yields theorem [2j 

Lemma 6 The relation Bb tq (N) -< n~ q ^l 2 holds under concentration assumption if respectively the 
overlapping setting is used and one among the following relations hold as n —> oo 



(t + x + c < oo, 

- (l V (CQ^b^LQi) )^ V (6L(6) 2+C )^) -< 



n 

oo 



A - dependence: + l) 9 2 A(t)2+c < oo, 
t=o 

- (l V (C(6) 2 6 c ~ 2 L(6) 2c )^ V (C(6)6- 2 L(6) C )^ v {C {b)b c ~ 2 L{b) 2c )^ ~< n~ & 
or the non-overlapping setting is used and 

n-l 2+c 

rj- dependence: y~](t + l) q ~ 2 r](t) i+i -< ft 9-2 , 

i=0 

- (l V (C(6)(6L(6)) c )i^ V (6L(6))it?) -< n"*, 

n-l 

A-dependence:^(i + l) 9_2 A(t)5+f -< b q ~ 2 , 
t=o 

1 V (C(6)(6L(6)) C )^ V (C{b)(bL(b)) c )^ V (C(6)(6L(6)) 2c )^) -< n' 5 . 
This lemma together with lemma Q] yields theorem [3l 
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6.3 Proof of Theorem [5] 



Put k n = [n/a n \. Partition {1, . . . ,n} into k n blocks of size a n 

Jj = Jj,n = {(j — 1) Q-n + 1) • • • ij a n\ i J ' = L • • • j k n , 

and, in case k n a n < n, a remainder block, Jk„+i = {k n a n + 1, . . . , n}. Observe that 



F(M n < w n {x)) 



n {m < Wn (x)} 

3=1 



where M (Jj) = maxjgj^. (Xj). Since P(M(Jj) > iy n (ar)) < a n F(w n (x)) — > as n — >• oo, the remainder 
block can be omitted and 

(fe„ \ 

f| {M(Ji) J +o(l). 



Let 



Jj — Jj n — {(j 1) a n + 1, . . . , ja n / n } , j — 1, ... , fc n , 
= "^jr,n = {j&n ^tii • • • ? ja n } , J = 1, . . . , /c n . 



Since P (U"=i M JjJ > w n (x)J < A: n / n F (w n (x)) -> as n -> oo, we deduce that 

An \ 

P(M n < Wn (x)) = P I P {M (J*) <w n (;r)}J 
Let 5j = = |i\J (j*) < u> n (x)j. We write 

/ k n \ 

p -n p ( s i) 



V?'=i / j'=i 



k n I k n i \ k n 

em n B A n n^-p n s i n ^ 

3=1 / j=fcn-i+2 \j=l / j=fc n -i+l 



i=l 

fcn / / k n -i+l 

= e » n B, 

*=1 \ \ 3=1 

We want to bound the following quantity 

kn—i+1 



p( n Bj 

3=1 



fc n 2 \ \ fc n 

pi ^ nBk n -i + x) n p(BjO 

3=1 / / j=k n -i+2 



kn i 

P Bj ] P(£ fe „_ i+ i) 

.3=1 



Let us define fn (y) = \ y <w n (x)}- Let (a n ) be a sequence such that a n — )■ as n — > oo and put 

and x„ = x + a n . We simply approximate the function /A by Lipschitz and bounded 
functions g n ,h n £ F\ with 

ft- ] <9n< A X) <K< ft t] 
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and we quote that it is easy to choose functions g n and h n with Lipschitz coefficient u n a n l . For I C 
{1, . . . , n}, let H!(fi x) ) = E []Jiei fn\Xi)] . Note that 

Hdft^) < Hr(g n ) < Hj(f^) < Hj(h n ) < 
Let C IyJ (fn X) ) = H IUJ (fi x) ) - Hjifi^Hjif^), we have 

Ci,j{g n ) - S ItJ (g n , hn) < C IyJ {f n x) ) < C IyJ {h n ) + 5 IyJ (g n , h n ) 

with 

$i,J (9n, K) = H^hnjHjthn) - H I (g n )H J (g n ). 
Let Ii = [l: {Xi < w n (x)} G flfeT^} and J t = {I : {X* < w n (x)} G B kn _ i+1 }. We have 

|# 7i (/i n ) I < (k n -i + l)a n (F(w n (x-))-F{w n (x+))) 
\H, h {hn) - Hj.(g n )\ < a n {F(w n (x-))-F(w n (x+))) 



Then we have 
and 

Note that as n — > oo 



Ci itJi {& x) )\ < \C h ,. h {K)\ V \C htJi (g n )\ + \8 htJi (g n ,h n ) | 
\S h , Jt (g n ,h n ) | < \H h {h n ) - H h (g n )\ + Iffj^/in) - H Jt (g n )\ . 



n (F{w n {x-)) - F(w n {x+))) ~ 2a n7 (l + 7 ^)+ 1/7 
If X is 77-weakly dependent, it follows that 

-1/7-1 (k n -i + 2) a r 



Ch,Ji(fn X) ) <(k n -i + 2) a n u n a n l r](l n ) + 2a n7 (l + jx)[ 
An optimal choice of a n is then given by 

a n ~ [n??(/ n )n„] 1/2 

and then 



n 



It follows that 

[]B j -n^) 

j'=i / i=i 
If X is A- weakly dependent, it follows that 



-< fc n (n?7(/ n )u n ) 1/2 



Ci^ifW) < [(k n - i + 2) a n u n a' n x + - i + 1) a n u n a> n 

1/7-1 (fc n - z + 2) q n 



+2q„7(1 + 7 x) + 
An optimal choice of a n is then given by 



n 



«n ~ [k n Hln) u n] 1/2 V [& n A(Z n )^n] ^ 
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C h Af<h x) ) -< ([n\(l n )u n f 2 v[na n \(l n )u 2 n ] 1/3 ). 



It follows that 



0=1 / j=i 



-< k n ([n\(l n )u n } 1/2 V [na n X(l n )u. 



I] 1 ' 3 ) 



Finally we deduce that 

P(M n < w n (s)) = [P(M n < w an (x))] fc " + o(l) 

and the result follows. 
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